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Preface 


A NASA Langley workshop on Automation and Robotics for 
Space-Based Systems was held on December 10, 1991, from 8:30 a.m. 
to 4:00 p.m. This conference proceedings document presents the 
overhead slides from each speaker at this event. The purpose of this 
in-house workshop was to assess the state-of-the-art of automation 
and robotics for space operations from a Langley Research Center 
perspective and to identify areas of opportunity for future research. 
The workshop was sponsored by the Guidance, Navigation, and 
Control Technical Committee, chaired by Dr. Raymond C. Montgomery. 

Nineteen talks were given, reflecting a high level of interest in 
the field of automation and robotics at NASA Langley. Over half of 
the presentations came from the Automation Technology Branch, 
covering telerobotic control, EVA and IVA telerobotics, hand 
controllers for teleoperation, sensors, neural networks, and 
automated structural assembly, all applied to space telerobotic 
missions. Other talks covered RMS active damping augmentation, 
space crane work, modeling, simulation, and control of large, flexible 
space manipulators, and virtual passive controller designs for space 
robots. 

The 1991 NASA Langley Workshop on Automation and 
Robotics for Space-Based Systems provided a good overview of 
current effort in this field at NASA Langley. The workshop served to 
open or renew lines of communication between various researchers 
working in diverse areas of automation and robotics. This document 
summarizes the talks of this workshop using the presentation 
overheads. 


Robert L. Williams II 
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Single Arm System 
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Single Arm Axis System 
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World axis system 


Single Arm Control Systems 
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Single Arm Hand Controler Axis System 
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World axis system 



ISRL HAND CONTROL FLOW DIAGRAM 










Single Arm Position Axis System 
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World axis system 


ISRL POSITION FLOW DIAGRAM 











Single Arm Vision Axis System 
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World axis system 


ISRL VISION CONTROL FLOW DIAGRAM 



Determine Vision Error 








ISRL SINGLE ARM FORCE CONTROL FLOW DIAGRAM 
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Multi Arm System 
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Dual Arm Hand Control Axis System 
with Control Signals 
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World axis system 
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- Take advantage of symmetry of task. 

- To control compond manipulators. 

- Tracking of objects. 

Use of optimal load distribution. 
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Bob Williams 

Automation Technology Branch 
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Objective 
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Approach 
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Potential SPDM Tasks 
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Apply and Enhance Technology 
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Computer Hardware, Software, Communications 
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Disturbance Compensation 
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Summary 
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Space Station Freedom 

Background 
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Man-Tended Phase 

U.S. Lab Module Volume 
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source: LaRC SSFO 



IVA Robotics 

Goals 
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IVA Robotics 

ATB Program Purpose 
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IVA Robotics 

Approach 
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Experiment 

Protein Crystal Growth 
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Equipment 

Thermal Enclosure System 




Candidate Mockup Demonstrations 
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HAND CONTROLLER STUDY 
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Automation and Technology Branch 
December 10,1991 A. Terry Morris 



HAND CONTROLLER STUDY 
OF FORCE AND CONTROL MODE 
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ONE FULL STUDY IN 1SRL, AND ONE FULL STUDY IN TSRL 
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VIDEO AND AUDIO RECORDING. 



ISRL EXPERIMENTAL DESIGN - PILOT EXP 

COMPLETELY RANDOMIZED REPEATED MEASURES DESIGN 
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Total of 12 conditions per subject, three trials each. 






ISRL EXPERIMENTAL DESIGN 
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Counter balance for force conditions 

Total of 10 conditions per subject, three trials each. 

Levels of force are : none (0), force accomodation (1), 

force reflection with accommodation (2), 
modified force reflection with accommodation (3) 



TSRL FINAL EXPERIMENTAL DESIGN 
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SIGNIFICANT TASK BY GENDER INTERACTION IN TSRL 
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SIGNIFICANT PRACTICE BY TASK BY SUBTASK INTERACTION IN TSRL 


FACTOR ANALYSIS SUMMARY OF RESULTS 


2 


DC 

o 

Li. 

V) 

UJ 

t 

</> 

o 

£2 
2 UJ 
OX 
OH 

cc> 

ffl 

o 

Z UJ 

□ z 
to. 

SS 5 

gul 

81 

sg 

CLU- 

ffui 

Q-O 
Z DC 
UJ UJ 
>0. 

wg 

&« 

5 e 

o 


o 

UJ 

UJ 

DC 

X 

I- 

Q. 

o 

H 


O 

o 

X 

o 

2 


UJ 

O 

CC 

O 

LL 

d 

UJ 

0. 

I 

_l 

< 

3 

o 


UJ 

o 

CC 

o 


o 

UJ 

0. 

I 

< 

3 

Q 

Ull 

O 

CC 

o 

U. 

* 


m 


UN 

o 

CC 

o 

LL 

o 

z 

ti 

z 

< 

_l 

£01 


I- 

Q 

Z 

o 

o 


< 

CC 

UJ 

o 


Q 

< 

o 

CO 

< 

H 

Q 

Z 

< 


S 

CM 

8 


o 

§ 

E 

3 

CC 

LL 


UJ 

2 

5 

CO 

Q 


O 

o £ 

-I <0 
V o> 

fa 


H 


CC 

< 

I 'S 

yd 


£ 
g£ 

m cc 

° o 

Q. IL .. w 
jILdr 

E“*“a 

i- os S.S 




^ s 

z w 

< IO 

cc ^ 


cc 

<5T 

ofe 

O co 


o 

< 

O 


< 

cc S' 

* g 

JSg. 


UJ 

>2 

UJ 5 

«Or 
Q LL £ 

z cc 
< uj 2 
IQ.C 


UJ 

2 UJ 
|N 

s co 

i§~ 

o < t 

ife2s 

uj >■ 2 
CL CD C 


UJ 

N_ 

ggj 

z » 

< in 
I ^ 


UJ 

N 

CO P 

is 

< t" 
I c. 


1- 

CM 

1- 

CO 

H 

z 

UJ 

z 

UJ 

z 

UJ 

z 

z 

z 

o 

p 

o 

CL 

CL 

CL 

2 

2 

2 

O 

O 

O 

o 

o 

o 


55 


CUMMULAT1VE ^ _ 

PERCENT 61.327 57.577 54.637 59.64 

VARIANCE 



SUMMARY AND CONCLUSIONS 
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RESULTS OF TELEROBOTlC HAND CONTROLLER STUDY 
USING FORCE INFORMATION AND RATE CONTROL 
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Future 

Further analysis will test the significance of these and other results and their implications for telerobot design. 
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Laser RADAR Vision System 
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Why Laser Radar 
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SONAR cannot be used in space applications 


COHERENT LASER RADAR 
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Why Frequency Modulated 
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Insensitive to lighting conditions 


FMCW LASER BLOCK DIAGRAM 










Current Problems 
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• Solution - Fiber Optic Based Radar 



Lens 
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Neural Networks Modeling 
and Control of 


N92-27769 
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Don Soloway 

Automation Technology Branch 



Outline 


o 


o> 

in 

TJ 

<D 

r 

CO 

CD 

i 

CO 

o 

> 

o 

o 

uw^m% 

n 

O 


(0 o 
o> j- 

2 s 

CC S 
o cc 

3 <5 
© « 

'E t 

© M 

6 il 


= 1 
I? 

5>® 

o 5= 

CO 3 

CD O 


co 

T— to 

G) > 

9 1 

T- d> 

n 

in o 

E j= 
o o 

k. j— 
**- CO 
CO to 
~ CO 

c a> 
o nr 

E ^ 

SZ CO 

co a> 

E c 

8 8 
O 0> 
< CD 


i- m co ’tin 0 


68 


I Ml III II II nil Ill I I Hill I i 



Overview 



69 


0) 

> 


o 

0) 

n 





T3 

C 

CO 

</) 

0) 


A 

CO 

CL 

CO 

O 

0) 

c 

m mmm 


E 

a> 

*-» 

a> 

a 


<2 

a> 

■o 

o 

£ 

i— 

co 

a> 

c 

■ HM 

"T 

C 

o 

c 

(0 

CO 

</) 

o 

s 

0) 

c 

To 


CD 

c 


70 


2. Determine the applicability of neural networks 
as system controllers. 
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The Problem 
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Network Architecture 
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Step Response of Networ 
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Step response of the eighth order system. 
(100x100x8 recurrent network) 


Analysis 
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Impulse Response 

After being trained on a step response. 
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Impulse response of the eighth order system. 
(100x100x8 recurrent network) 




Extending The Work to Non-linear 
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Discrete Volterra Series 
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Neural Networks 
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h1(t1)= ae" n 

and h2(t1,t2) = be ^ t1+t2 ^ 




Results 
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Accomplishments 
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Objectives for the Next Year 
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Adaptive Artificial Neural Network 
for Autonomous Robot Control 
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Neural Network Controller for Robot 
Arm Positioning with Visual Feedback 
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Initial State of the Network 


View from both Cameras 
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Initial State of the Network 




Neural Network Controller for Robot 
Arm Positioning with Visual Feedback 
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State of the Network After Training 








Automatic Recovery From Cumulative Fault-Scenarios 
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Learning Steps 



Error Reduction by Iterative Fine Movements 



Learning Steps 





RMS ACTIVE DAMPING AUGMENTATION 
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RMS ACTIVE DAMPING AUGMENTATION 
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CONTROL LAW DESIGN PROCESS 
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performance 
evaluation (DRS) 
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MIMO ACCELERATION CONTROL LAWS 

IMPROVE DAMPING 
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POTENTIAL LOAD REDUCTION BENEFIT IDENTIFIED 
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DRS MODIFIED TO MODEL DISTRIBUTED 

ACCELERATIONS 
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ACCELEROMETER LOCATION DEFINED 

Wrist Yaw 
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SIMULATED SHUTTLE VIDEO DISPLAYS 
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SES TEST GOALS AND OBJECTIVES 
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SES MODIFICATIONS TO SUPPORT RMS 
ACTIVE DAMPING AUGMENTATION 
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SES Interfaces 
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A SPACE CRANE CONCEPT FOR 
PERFORMING ON-ORBIT ASSEMBLY 


N92-27772 
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BRIEFING OUTLINE 
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IN-SPACE ASSEMBLY AND CONSTRUCTION ENHANCES 
FUTURE MISSIONS PLANNING FLEXIBILITY 
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Missions -► Total Mass and Volume 





IN-SPACE ASSEMBLY AND CONSTRUCTION 

FACILITY CONCEPT 



114 


Positioning & Attachment 
End Effectors 
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• Scaleability (Larger or Smaller Sizes) for a Variety of Applications 

• Robustness and Reuseability for Long Life 



FUNDAMENTAL CHARACTERISTIC 
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HOW DO WE CONTROL THIS DEVICE? 


SPACE CRANE RESEARCH APPROACH 
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- VIBRATION CONTROL 

Bare Structure Performance 
"D” Strut Passive Dampers 
Preshaped Command Input 
Active Damping (Feedback) 




SPACECRAFT COMPONENT POSITIONING 
AND ASSEMBLY TEST-BED 
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Payload Storage 
Pallet 




ARTICULATING JOINT TESTBED 
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- GIVES RAPID COMPONENT REPLACEMENT AND/OR 
MODIFICATION CAPABILITY 


CONCLUDING REMARKS 
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BLACK AND WHITE PHOTOGRAPH 
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IMPROVED LINEAR ACTUATORS 
REDUCE ARTICULATING JOINT TEST 

BED BACKLASH 
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DEFLECTION, in DEFLECTION, in 









Boom 2 Tip Transient Response 
Finite Element Dynamic Model 



Time, seconds 




Boom 2 Tip Transient Response 
Finite Element Dynamic Model 
D-Struts in Bay 1 



Time, seconds 
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time, seconds X-coordinate. 



Boom 2 Tip Transient Response 
Shear-Corrected Component Modes 
Torque Driver Profile 
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Time, seconds 



Peak Root Member Force vs. Slew Time 
Torque Driver Profile 
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Slew time, seconds 



h 

o 



yj 



< 

cc 

o 


LU 

O 

< 

Q. 

£0 

U. 

O 



O 

CC 



o 

o 


Q. 


o 

o 




LU 

0. 





a> 

o 

k. 

CL 

C 

o 

to 

c 

£ 

X 

a> 


to 

3 

4 -* 

o >, 
<a £ 
c <a 

.2>E 

w a> 
a <d 


a> 

<u -C 
x: *- 
«- a) 

^ i: tn 
C Dtj 
© « <a 

ESo 


a> — 

t £ ? 

El« 

(5 Q) 
O (o 
♦- a> c 
cm= o 

> O Q. 

gS.8 

> g i 
.Q O c 

<q <o <d 
J £'</> 
© £> c 
« <0 


o 

(0 

2 

Q. 

Q. 

< 

TJ 

8 

o 

Q. 

O 



136 


LabVIEW 2 
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TELEROBOTIC ASSEMBLY FACILITY 

-v /- Robot arm with end effector 



■e motion base 
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Photo of Test Lab for Automated Assembly of Large Space Structures 
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BLACK AND WHITE PHOTOGRAPH 
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Photo of Truss Joint Connector in the Locked and Unlocked Condition 





ROBOT END EFFECTOR 







Assembly Projected Time 
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Typical Truss Assembly Break Down 





Movr arm to Inslall point 



Time (Min) 

Prrrrnt 

Movr arm lo ranlslrr 

02.08 

0.71% 

Arrjult r sf rut 

218.30 

23.20% 

Movr arm (o rrsl point 

12.13 

1.29% 

Position robot base and turntable 

79.27 

8.45% 

Movr arm to Install point 

1 53.02 

10.37% 

Inslall strut 

287.03 

30.05% 

Return arm lo rrst position 

124.48 

13.27% 

Total: 

938.42 
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AUTOMATED STRUCTURES ASSEMBLY FACILITY 
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Assembly Problem Summary 
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Sensor Monitoring and Error Recovery 
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Recommendations/Conclusions 
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Current Plans/Developments 
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Development of a Machine Vision Guidance System for 
Automated Assembly of Space Structures 


N92-27775 
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Automated Structural Assembly Robot Vision 
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Consistent and robust target identification and position estimation 
in the ASAL environment 



Machine Vision Requirements 
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Vision Hardware and Targets 
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Focused Light Mount | | New Target 




Reflective Efficiency 
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Observation Angle 
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Rotating motion base 

(a) Schematic of Automated Structural Assembly Laboratory. 



(b) Hardware in Automated Structural Assembly Laboratory. 
Figure 1. Automated Structural Assembly Laboratory. 


158 
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Target Identification 
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iscriminator 




Algorithms - Functional 
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Constraints 




ORIGINAL PAGE 

BLACK AND WHITE photograph 




L-92-19 


Figure 2. Joint receptacle target. 



L-9 1-6330 

Figure 3. Truss node with joint receptacle targets. 


162 




ORIGINAL PAGE 

BLACK AND WHITE PHOTOGRAPH 



L-91-6331 


Figure 4. Camera and light assembly. 



Figure 5. End-effector mounted camera and light assembly. 
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ORIGINAL PAGE 

BLACK AND WHITE PHOTOGRAPH 



Figure 6. Robot arm at typical vision approach point. 
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(b) After illumination. 
Figure 7. Concluded. 
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BLACK AND WHITE PHOTOGRAPH 



(a) Vision system view at range of «24 in. 



(b) Vision system view at range of «18 in. 
Figure 8. Typical incremental approach. 
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ORIGINAL PAGE 

SLACK AND WHITE PHOTOGRAPH 



(c) Vision system at range of «12 in. 
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(d) Vision system view at range of in. 
Figure 8. Concluded. 
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BLACK AND WHITE PHOTOGRAPH 



(a) Processed image after blob-size constraint applied. 



(b) Processed image after blob shape constraint applied. 


Figure 9. Sequential discrimination of target from background. 
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ORIGINAL PAGE 

BLACK AND WHITE PHOTOGRAPH 



(c) Processed image after exhaustive triangle generation. 



Figure 9. Continued. 



ORIGINAL PAGE 

BLACK AND WHITE PHOTOGRAPH 



(e) Processed image after triangle slope constraint applied. 



(f) Processed image after length, area, and angle constraints applied. 

Figure 9. Continued. 
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ORIGINAL PAGE 

8LACK AND WHITE PHOTOGRAPH 



( K ) Processed image after target lock-on and pose estimation. Top two lines of key give position vector in 
W inches and millimeters, respectively. The bottom line gives rotation vector in radians. 


Figure 9. Concluded. 
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Vision System Results from Optical Bench Tests (X Axis) 
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Relative Position in Region of Interest 



Vision System Results from Optical Bench Tests (Y Axis) 
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Relative Position in Region of Interest 



Future Work 
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END-EFFECTOR 

MICROPROCESSOR 


by 


WILLIAM R. DOGGETT 
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Why? 


- require one interface to all end-effectors 

in ASAL 

- each with unique control and sensing 

requirements 

- common command interface 

- require concurrent capability 

- must reduce number of signal lines 

required to operate each end-effector 

- desire to relieve merlin robot of end- 

effector responsibility 
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AUTOMATED STRUCTURES ASSEMBLY FACILITY 
CURRENT CONTROL HIERARCHY 



MENU INTERFACE 


SERIAL INTERF 
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AUTOMATED STRUCTURES ASSEMBLY FACILITY 
PURPOSED CONTROL HIERARCHY 
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INSTALL 




BLOCK DIAGRAM FOR INSTALL COMPOSITE 


begin 



INSTALL_REVERSE 
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CONCLUSIONS 


IMPROVED MODULARITY 

CONSISTENT INTERFACE TO THE 3 END-EFFECTORS 
SUPPORT FOR CONCURRENT OPERATIONS 
SUPPORT FOR PAUSE/REVERSE AT ANYTIME 
SUPPORT FOR OPERATOR OVERRIDE 
POTENTIAL FOR INCREASED RELIABILITY 
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Cuong Quach 



Design Requirements for 
Panel Installation Process 
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Panel latches to truss via adaptors 
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Panel end effector 
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retreiving panel from canister 
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installing panel 
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Facility view with panel installed 
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Design layout of the automated assembly system. 
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Menu display for automated composite command (Fetch & Connect). 
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. Direct 

. Capture sequence 
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FUTURE WORK IN 
AUTOMATED ASSEMBLY OF 
LARGE SPACE STRUCTURES 
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Automated Assembly of Large Space Structures 
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guidance and collision 
avoidance path planner 


Current System Upgrade Requirements 


* Taught Paths and Points Are Not Viable 

Sensor/Vision Feedback 

- Path Planner/Collision Avoidance 

* Flat Truss Is Not Useful 

- Curved Truss/Generalized End Effector 


* Serial System with Excessive Communication 

- Distributed Architecture & Embedded 
Microprocessors 


* Single-Task Operation 

- Panel Installation 

- Beam Assembly 


* Need Flexibility of Knowledge-Based Artificial 
Intelligence 

- Expert System Executive 

- Automated Path Planning 

- Automated Sequence Planning 



ASAL 1992 OBJECTIVES 


I. Complete end-to-end assembly/disassembly of 
combination Truss/Panel structure 
using: 

- Machine vision for struts 

- Expert system executive 

- End effector microprocessors 


II. Static manipulator arm will develop: 

- Generalized end effector sequences & 

procedures for curved truss, supported by 
expert system 

- VX-Works based distributed architecture for 

in-loop force/torque & path planning 


III. Real-time graphics simulation to: 

- Develop generalized end effector paths 

- Study assembly sequence planning 

- study operator interfaces 


IV. Design end effector for curved Precision Segmented 

Reflector (PSR) truss joints which are not specificially 
designed for robotic operations 


V. Assemble tetrahedral beam 
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Presentation Outline 
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Model Used 
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Joint Motor Modelling 
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Virtual Work 
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System Simulator 
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Conclusions and Future Plans 
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Hardware evaluations 


Modeling, Control, and Simulation 
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Spacecraft Controls Branch December 10, 1991 

NASA Langley Research Center 


WBS PROGRAM GOAL ROADMAP 
WBS 40 - 1 

Advanced System Modeling and Control 



'Modern Robust Control 
Techniques" 




Automated * Utilize Callable • Real Time 

"C" Subroutines Graphics. 
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-> Extremely memory intensive. 

-> Difficulties handling multiple complex mode shape 
expressions. 


MODELING SOFTWARE: MAPLE 
M.I.T. developed applications package 
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MODELING SOFTWARE: 
M.I.T. sample input data file 
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CONTROL DESIGN INTERFACE 
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REAL TIME SIMULATION 

PROCESS 1 PROCESS 2 
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GRAPHICS WORKSTATION 
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DIMENSION 6 
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PASSIVE DYNAMIC CONTROLLERS FOR 


N92-27782 



233 


NASA Langley Research Center 
Hampton, VA 23665 
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CONCLUSIONS 
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DYNAMIC CONTROLLER IS EXTENDED TO 
NON-LINEAR MULTI-BODY MECHANICAL SYSTEMS 


OBJECTIVE 
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ECHANICAL 

SYSTEM 
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• EXTENSION TO NON-LINEAR SYSTEMS IS BASED ON 
■ Work-Energy Rate principle 



BASIC CONCEPT 
(Work-Energy) 
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BASIC CONCEPT 
(Liapunov Theory) 
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LIAPUNOV FUNCTION 
(Displacement Feedback) 
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• Asymptotic stability can be accomplished even though 
the Liapunov function is only positive semi-definite and 
its time derivative is only negative semi-definite. 


DYNAMIC CONTROLLER 
(Displacement Feedback) 
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LIAPUNOV FUNCTION 
(Displacement & Acceleration Feedback) 
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• Asymptotic stability can be accomplished even though 
the Liapunov function is only positive semi-definite and 
its time derivative is only negative semi-definite. 


DYNAMIC CONTROLLER 
(Displacement & Acceleration Feedback) 
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PHYSICAL INTERPRETATION 
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PHYSICAL INTERPRETATION 
(Displacement Feedback) 
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PHYSICAL INTERPRETATION 
isplacement & Acceleration Feedback) 




APPLICATION 
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A Six-Degree-of-Freedom Robot 




CASE STUDY 
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CASE STUDY 
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SIMULATION RESULTS 
(Displacement and velocity feedback) 



(ill) }U0LU0OB|dSjp 


251 


y-Position of the End Effector 



SIMULATION RESULTS 
(Displacement and velocity feedba 
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z-Position of the End Effector 




SIMULATION RESULTS 
(Displacement and velocity feedback) 
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Modal Displacement of First Mode of the Lower Arm 



SIMULATION RESULTS 
(Displacement feedback) 
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time (sec) 

x-Position of the End Effector for Different Values of 
Control mass with Large Control Stiffness 




SIMULATION RESULTS 
(Acceleration & displacement feedback) 
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Elbow Pitch Displacement for Different Values 

of Control Stiffness 
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time (sec) 

Shoulder Pitch Displacement for Different Values 

of Control Mass 




SIMULATION RESULTS 
(Acceleration & displacement feedback) 
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measurements 

■ Physical meaning of controller parameters useful for 
tuning 
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